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Low Memory Digital Audio Effects Using Down^sampilng Up-sampling Technique 
FigW of Invsmion 

S This invention is appiicable in ilie Geld of Digital Audio Effects Algorithms (e.g. edio. 
chorus, reverberation, flanging) implemented on a DSP with reduced memory usage 
requirement. 

Background of the Inveniion 

10 

Audio effects, such as echo, chorus > reverberation and flanging are indispensable in systems 
^ such as music production, home entertainment (Hi-Fi), car audio ^d Karaoke Systems. 
Often these effects are implemented using digital signal processors, with associated memory, 
input-output peripi]ierals, analogue-co-digitai and digital-to-analogue converters. 

IS 

The processor takes in the "dry" input, produced by an instrument such as a keyboard or 
previously recorded on some analogue medium, and samples it at an appropriate rate. It is 
also possible that the input comes from a digitally recorded source (e.g. 44. 1 kHz. sampled 
Audio CD) . in which case no additional sampling is required. Whatever the source, the final 
20 input stream is in digital fonn so that it can be subjected to DSP effects algorithm. The 
resulting "wet" stream is reconstructed to analogue form, to be sent to the next unit in the 
audio chain, such as speaker system, a recording channel, a mixer, or another efifects 
processor . 

25 In all digital audio effects the basic element is the delay-buffer, several of which may be 
combined to form complicated effects such as reveri^ration. Traditionally, the delay buffer 
stores data at the same rate as the input sampling rate. Therefore the delay buffer size is a 
function of not only of the maximum delay allowed in the system but also of the sampling 
frequency. 

30 Delay Buffer Size (words) = Max. Delay (ms,) x Sampling Frequency (kHz.) 
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The memory requirement can be prohibitive when it comes to implemeniing effects such as 
reverb where delays of over 200 ms. are often desired. 

This inveniion attempts to decrease memory requirements for effects algorithm without 
5 affecting quality appreciably. 

Summary of the Invention 

In accordance with the invention* there is provided a method of introducing digital audio 
10 effects in an audio signal including: 

receiving an input stream at an input sampling frequency; 

down-sampliog the iiq>ut stream so that a selected number of sample data are retained; 
applying a digital audio effect to the selected number of san^Ie data; and 
up-sampliz^ the sample data to a predetermined output frequency. 

15 

In another aspect, there is provided a digital signal processor includmg an audio effect engine 
for introducir^ a digital audio effect in an audio signal, including: 

a down-sampler for down-sampling an input signal to a selected number of sample 

data; 

20 an audio effects engine for applying the digital audio effect to die sample data; and 

an up-s2unpler for up-sampling the saxz^le data* to which the audio effect has been 
applied, to a predetermined output frequency. 

The input data may be converted to a lower sampling frequency at, for example, a ratio of 
25 4:1. At lower sampling rate* the amotmt of data is lesser« for the same duration of the signal. 
The algorithm introduces effect at this frequency. For generating the ouQ)ut the effect added 
samples are reconverted to the desired output frequency. 
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The invention is more ftiily described by way of non-Hmiiing example only, with reference 
to the accompanying drawings » in which: 
5 Figure 1 illustrates audio effects operating at a constant sampling rate; and 

Figure 2 Illustrates a down-sampling/up-sampling technique to decrease delay-buffer 

size. 

netailed Desc rmtion of a Preferrefl Fmbndiment 

10 

Consider the effects engine in Figure 1. The input stream is arriving at die rate of 44,1 kHz, 
If a delay of 200 ms. is required, the buffer size for single channel would be 

Delay Buffer Size (words) =« Max, Delay (msj x Sampling Frequency (Mfe.; . . 
15 « 200 ms. X 44. J kHz. = 8820 words 

This would be considered a large amount for a Karaoice System. One method of avoiding such 
large size could be to keep ciata in the buffer in a compressed fonnat. However, it comes with 
several difficulties. If a Lossy compressor such as AC-3 or MPEG is used, the computation 
20 lequirement for encoding and decoding is very high. Lossless conqpiression will not give bigb 
compression, and in addition to that the compression ratio is not fixed. 

The buffer size above can also be decreased if the amount of data necessary for representing 
the signal for same duration (Max, Delay) is decreased. This can be realised by performing 
25 sampling rate conversion. At a lower sampling rate the same duration of the signal can be 
represented using fewer samples. High frequency contents of the signals will have to be 
discarded, bur this may be acceptable in cases where listening and singing environment 
(microphone, analogue-to-digital converters etc.) are of commercial level quality only, 

30 F^;ure 2. shows the Down-Sampling Up-Sampling Technique for reducing buffer size. Prior 
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to storage or any action by Hxe audio effects engine, the input stream passes through an 
ami-aliasing fitter -hdecimmor. The anti-aliasing filter removes frequency components above 
ir/M where is the decimation fector. Decimation by N means that one out of every N 
sample data is retaijoed, the rest are durown away. Decimation causes the high frequency 
5 components (above sampUiig_£tequency/C2*N)). to wrap around and appear as ghost 
frequency components at lower frequency. To avoid these ghost components, the high 
frequencies are suppressed so that the wrap around is not audible. 16-bit pcm (pulse code 
modulated) has 96 dB SNR, dierefore an anti-aliasing filter with stop-band attenuation around 
100 dB. would be sufficient. 

10 

After decunation, data from input stream is ready for storage into buffer and also available 
to the audio effect engine. The manner in which the effects algorithm acts upon this data 
depends on the actual effect it implements. Simple effect such as echo are implemented as 
y[n]^a*x[ri}+il^)xln-Dh O^a^l, x[nl being the current input, y(nj the output and.D the 
15 delay. The output is a simple fimction of current input and a delayed version it. 

Complex algorithms such as reverb require current input as well as pre-processed ii^ut at 
various delay rime. All such delay times may have to be scaled to obtain equivalent time in 
terms of the decimated samples. Moreover, most effects' algorithms have lattice-filter 
20 coefficients adjusted to the pre-defined frequencies of operation (e.g. 44.1KHz). They have 
to be adjusted to the operating sampling frequency of die delay-bu£fer« Once these 
adjustments are done, running the effects algorithm is really straightforward as it effectively 
operates at the down-sampled frequency. 

25 The output from die effects' engine has to be ren^onverted to the desired output frequency 
through an up-sampling process. Up-sampling consists of two steps, the first being the 
expansion stage wherein each data is preceded by N-1 zeros* where N is the up-sampling 
ratio. Zeros insertion causes the spectrum to shrink by N. Therefore frequency images at 2tz 
intervals (created due to sampling process) come within the O^/iTU boundary. They are 

30 removed by an anti-aliasing filter with cut-off at n/N. Looking equivalenrly at the time 
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domaiii behaviours of the filtering process, the inserted zeros are changed to new values, 
obtained by interpolation behaviour of the filter. 

It is to be noted chat if die decimation and expansion ratio are same, the same filter may be 
S used for both decimation and expansion steps. 
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THE CLAIMS DEFEONG THE INVENTION ARE AS FOLLOWS: 

1 . A method of introducing digital audio effects in an audio signal including: 
receiving an iziput stream at an iiqnxt sampling frequency; 

5 down-sampling the input stream so that a selected number of sample data are retained; 

applying a digital audio effect to the selected number of sample data; and 
up'sampling tbe san^ie data to a predetermined output frequency. 

2. A method as claimed in clann 1, wherein the down-sampling inchides removing 
10 frequency componems from the input stream and applying a decimation factor such that only 

the selected number of sample data are retained 

3. AmeihodascIaimedinaiQf one of the preceding claims, wherein the down-s 
iTv^iiiri^ft passing the input stream through an anti-aliasing filter for the removal of frequency 

1 5 componentg, the filter being operable to remove frequency components above ic/AT, where N 
is the decimation factor, in that one out of every N samples are retained. 

4. A method as claim in claim 1, wherein the up-sampling includes expansion of the 
sample data by insertion of zeros. 

20 

5. A method as claimed in claim 4, wherein the up-san:^ling further inchides passing the 
expanded sample ^ata through an anti*aliasing filter with cut-off at ic/iV, where iV is the up- 
sanqiling ratio. 

25 6. A method as claimed in claim 5, wherein the zeros introduced with expansion of the 
sample daca are changed to new values, based on interpolation behaviour of the filter. 

7. A method as claimed in any one of the preceding claims, wherein the retained sample 
data are stored in a buffer prior to application of the audio effect. 

30 
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8. A digital signal processor^ including: 

a down-sampler for down-sampling an input signal to a selected number of sample 

data: 

an audio effects engine for applying a digital audio effect to the sample data; and 
5 an up-sampler for up-sampling the sample data, to which the audio effect has been . 

applied, to a piedetermiiied output frequency* 

9, A digital signal processor as claimed in claim 8, wherein the down-sampler includes 
an anti-aliasing filter and a decimator, the decimator being arranged to retain the selected 

10 number of sample data by applying a decimation factor N and retaining one out of every N 
sample data input to the down-sampler, and wherein the anti-aliasing filter is effective to 
remove frequency components above 3u/iV. 

10, A digital signal processor as claimed in claim 8» wherein the up-sampler includes an 
' 15 anti-aliasing filter and an expansion means for inserting N-l zeros before each sample data, 

to which the audio effect has been fVpUed, where ^ is the ly-sampling ratio, and wherein the 
anti-aliasing filter has a cut-off at 

11. A digital signal processor as claimed in any one of claims 8 to 10, further ingJudir^ 
20 a buffer in which the selected number of sample data are stored prior to application of the 

audio effect. 
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Figure 2. Dcwn-Sampling Up-Sampling to Decrease Delay-Buffer Size 
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